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ABSTRACT 

We  study  the  computation  of  the  dual  frame  for  oversampled  filter 
banks  (OFBs)  by  exploiting  Greville’s  formula,  which  was  derived 
in  1960  to  compute  the  pseudo  inverse  of  a  matrix  when  a  new  row 
is  appended.  In  this  paper,  we  first  develop  the  backward  Greville 
formula  to  handle  the  case  of  row  deletion.  Based  on  Greville’s  for¬ 
mula,  we  then  study  the  dual  frame  computation  of  the  Laplacian 
pyramid.  Through  the  backward  Greville  formula,  we  investigate 
OFBs  for  robust  transmission  over  erasure  channels.  The  necessary 
and  sufficient  conditions  for  OFBs  robust  to  one  erasure  channel  are 
derived.  A  post-filtering  structure  is  also  presented  to  implement  the 
dual  frame  when  the  transform  coefficients  in  one  subband  are  com¬ 
pletely  lost. 

Index  Terms —  Error  resilience.  Frames,  Greville  formula,  Lapla¬ 
cian  pyramid.  Oversampled  filter  banks. 

1.  INTRODUCTION 

Over  the  past  few  years,  there  have  been  increased  interests  in  the 
study  of  frame  expansions  due  to  their  extra  design  freedom  and  im¬ 
proved  noise  immunity  (e.g.,  [1^]  and  the  references  therein).  From 
a  signal-processing  point  of  view,  frames  in  E(Z)  correspond  to  per¬ 
fect  reconstruction  (PR)  oversampled  filter  banks  (OFBs).  Consider 
an  A^-channel  OFB  with  the  sampling  factor  of  M,  where  M  <  N. 
Let  the  N  x  M  polynomial  matrix  E(z)  and  the  M  x  N  polynomial 
matrix  R(2)  denote  the  analysis  and  synthesis  polyphase  matrices, 
respectively.  For  PR-OFBs,  £(«)  and  R(z)  should  satisfy 

R(2)E(2)=Im.  (1) 

In  other  words,  R(2)  is  the  left  inverse  of  R(2) .  Unlike  conventional 
filter  banks,  given  E(2),  there  are  multiple  R(2)  which  meet  (1). 
Among  them,  the  most  significant  one  is  its  para-pseudo  inverse,  or 
the  dual  frame,  which  is  given  by  [2] 

Et(z)  =  (e"(«)E(2))“'e"(2),  (2) 

where  the  superscripts  H  and  f  represent  respecitvely,  the  Hermitian 
transpose  and  the  dual  frame.  The  dual  frame  correspond  to  synthe¬ 
sis  filters  with  the  minimum  norm.  Besides,  in  the  ideal  case  when 
the  quantization  noise  is  uncorrelated  and  white  with  equal  variance, 
the  dual  frame  is  the  optimal  solution  to  minimize  the  reconstruction 
errors  [2,4].  However,  its  computation  in  (2)  requires  the  inversion 
of  the  polynomial  matrix  E^(2)E(2),  which  could  be  a  costly  task. 
Although  some  state-of-the-art  software  can  provide  numerical  ap¬ 
proximations,  they  cannot  generate  closed-form  solutions. 

Note  that  in  the  special  case  when  E(2)  is  a  zero-order  matrix, 
i.e.,  when  E(2)  =  E,  the  dual  frame  reduces  to  its  pseudo  inverse. 


An  efficient  way  to  calculate  the  pseudo  inverse  is  through  the  recur¬ 
sive  Greville  formula  [5],  which  updates  its  pseudo  inverse  when  a 
matrix  is  augmented  by  a  row  (or  column)  vector.  Based  on  the  Gre¬ 
ville  formula,  we  derive  the  closed-form  solution  of  the  dual  frame 
for  the  Laplacian  pyramid  [6].  We  further  develop  the  backward 
Greville  formula  to  compute  the  pseudo  inverse  when  a  row  (or  col¬ 
umn)  of  a  matrix  is  deleted.  This  is  mainly  motivated  by  the  fact  that 
frames  can  be  used  as  error-resilient  tools  to  combat  erasures.  In  the 
presence  of  coefficient  loss,  the  signal  can  still  be  reconstructed  us¬ 
ing  the  dual  frame  of  the  remaining  analysis  bank  [7].  The  backward 
Greville  formula  facilitates  the  analysis  of  OFBs  in  the  presence  of 
erasures. 

The  rest  of  this  paper  is  organized  as  follows.  In  Section  2,  we 
present  the  Greville  formula  and  derive  the  backward  Greville  for¬ 
mula.  Applications  of  Greville  formulas  are  demonstrated  in  Section 
3  and  Section  4,  respectively.  Specifically,  we  study  the  Laplacian 
pyramid  [6]  in  Section  3,  and  examine  OFBs  for  erasure  channels  in 
Section  4.  Finally,  we  draw  conclusions  in  Section  5. 


2.  FORWARD  AND  BACKWARD  GREVILLE  EORMULAS 
2.1.  The  Greville  Eormula 


Suppose  that  Ejv(2:)  is  an  W  x  M  analysis  polyphase  matrix  of  a 
PR  OFB.  Let  us  partition  it  into 


Eaj  (z) 


EAr-l(z) 

ejv(2) 


(3) 


where  Ejv_i(a:)  is  the  {N  —  1)  x  M  submatrix  and  ejv(z)  is  its 
last  row.  Assume  further  that  we  know  E]y_j^(2).  The  Greville 
formula  [5]  computes  EjY(2)  from  E]y_j^(2)  and  eN{z)  as  follows: 
Set 

d(z)  =  eAr(2)Ej,,_;^(2) 

and 

c(2)  =  eiv(z)  -  d(z)Ejv_i(z); 

Case  1:  If  c(z)  =  0,  set 


Case  2:  If  c{z)  0,  set 


then 


riv(2) 


c(2) 

C(2)C«(2)’ 


il]v(z)  =  [e]v_i(2)  O]  +r§{z)  [-djv(z)  l] 


(4) 
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can  be  implemented  through  an  (M  +  l)-channel  PR-OFB  with  the 
sampling  factor  of  M,  whose  polyphase  matrix  is 


2.2.  The  backward  Greville  Formula 

In  this  subsection,  we  aim  to  derive  the  reverse  problem.  That  is, 
snppose  we  know  E]y(2),  how  to  calculate  Ejy_j(2)?  The  answer 
is  presented  in  Theorem  1 . 

Theorem  1.  (Backward  Greville  Formula)  Suppose  that  the  N  x  M 
matrix  E(2)  is  as  defined  in  (3).  Partition  its  dual  frame  EjY(2)  into 
the  form  of 

E]v(2)  =  [Riv-i(2)  rf  (2)]  ,  (5) 

where  Rjv_i  (2)  is  the  M  x  (N  —1)  submatrix  and  (2)  the  M  xl 
column  vector.  Then,  the  dual  frame  o/Ejv-i(2)  is  given  by 

E]v_i(2)  =  Rjv-i(2)  +  rf  (2)djv(2), 
where  djv(2)  can  be  expressed  as 


ejv(2)Riv-i(2) 

1  -  eiv(2)rf  (2)’ 

ifeN{z)r§{z)  <  1 

(6) 

rAr(2)RjV-l(2) 

rjv(2)r"(2) 

ifeN{z)r§{z)  =  1 

(7) 

Remarks 

1.  In  the  backward  Greville  formula,  (6)  and  (7)  correspond  to 
Case  1  and  Case  2  of  the  forward  Greville  formula,  respectively. 

2.  In  the  above  Theorem,  we  only  consider  the  cases  when 
eN{z)r^{z)  <  1.  Interested  readers  may  ask  whether  it  is  possible 
to  have  eiv(2)r^(2)  >  1?  The  answer  is  no.  Detailed  derivations 
will  be  presented  in  the  journal  version. 

3.  The  backward  Greville  formula  was  also  investigated  in  [8]. 
But  the  derivations  there  are  limited  to  the  case  when  the  row  vectors 
in  Ejv(2)  are  independent.  In  other  words,  our  derivations  are  more 
general. 

3.  DUAL  FRAME  FOR  LAPLACIAN  PYRAMIDS 


a[n] 

cfn] 


Fig.  1.  Implementation  of  the  LP  frame. 


To  demonstrate  the  application  of  the  Greville  formula,  this  sec¬ 
tion  considers  the  computation  of  the  dual  frame  for  the  laplacian 
pyramid  (LP)  [6],  which  has  been  proved  to  be  a  useful  tool  for  im¬ 
age  processing  and  computer  vision.  Fig.  1  shows  its  implemen¬ 
tation  diagram,  where  H{z)  and  G(2)  represent,  respectively,  the 
decimation  and  the  interpolation  low-pass  filters.  The  output  signal 
is  made  up  of  two  components:  the  coarse  signal  c[n\  represents  the 
low-frequency  components  of  the  original  input,  while  the  details 
(with  band-pass  and  high-pass  frequency  components)  are  contained 
in  d[n\. 

As  x[n\  can  be  always  reconstructed  from  c[n]  and  d[n],  the  LP 
realizes  a  frame  expansion  [9].  From  the  FB  point  of  view,  the  LP 


Eip(2) 


l-g^{z)h{z) 

h(2) 


(8) 


where  the  M  x  1  vectors  h(z)  and  g{z)  represent  the  Type-I  polyphase 
matrices  [10]  of  the  low-pass  filters  of  H{z)  and  G(2),  respectively. 
Although  PR  can  be  achieved  for  any  pair  of  H(z)  and  G(2),  a  typ¬ 
ical  choice  is  to  set  H (z)  and  G(2)  as  biorthogonal  filters.  Under 
this  restriction,  the  corresponding  polyphase  matrices  satisfy 

h(2)g"(2)  =  1.  (9) 


In  the  special  case  when  H(z)  is  an  orthogonal  filter  and  G(2)  = 
H{z)  [9],  (9)  is  reduced  to  h(2)h^(2)  =  1.  Accordingly,  Eip(2) 
is  a  paraunitary  matrix  [10]  and  its  dual  frame  is  its  Hermitian  trans¬ 
pose  E^2)  =  Eg  (2) 

Our  purpose  here  is  to  derive  a  closed-form  solution  for  Eg  (2) 
when  (9)  holds.  First,  note  that  when  h(2)  and  (z)  satisfy  (9), 
D(2)  =  I  —  g^(2)h(z)  is  a  rank-deficient  matrix  as  one  of  its 
eigen-value  is  zero  [9].  Using  the  Woodbury  formula,  we  can  show 
that  the  para-pseudo  inverse  of  D  (2)  is  [11] 


Dt(2)  =  Im- 

+ 


g"(2)g(2)  h^(2)h(2) 

g(2)g«(2)  h(2)h«(2) 

g«(2)h(2) 

h(2)h«(2)g(2)g«(2)- 


(10) 


Next,  note  that  Eip(2)  satisfies  the  PR  property  [9].  Hence,  it  is  of 
full  rank  on  the  unit  circle,  i.e.,  r’anfc(E;p(e'’“)  =  M  .  As  D(z) 
is  a  rank  deficient  matrix,  the  row  vector  h.{z)  is  not  in  the  range  of 
D(2).  Accordingly,  we  can  use  Case  2  of  the  Greville  formula  to  get 
Eg(2),  as  presented  in  the  following  theorem: 

Theorem  2.  For  the  LP  frame  shown  in  Fig.  1,  let  its  (M  -\-l)  x  M 
polyphase  matrix  Eip{z)  be  given  as  in  (8).  Suppose  that  H{z)  and 
G(z)  are  biorthogonal  filters  with  their  polyphase  matrices  satisfy¬ 
ing  (9).  Then,  its  dual  frame  can  be  expressed  as 

(11) 


Proof.  The  derivation  of  (11)  is  quite  lengthy.  To  prove  that  (11) 
is  indeed  the  dual  frame,  we  will  show  that  it  satisfies  the  Moorse- 
Penrose  equations  [11] 


Eip(z)Eg 

(2)Eip(2)  =  E;p(2); 

(12) 

Eg(2)E,p(2)Eg(2)  =  Eg(2); 

(13) 

(Eip(^)Eg( 

2))"'  =  E,p(2)Eg(^); 

(14) 

(Eg(^)E,p( 

2))"  =  Eg(2)E,p(2); 

(15) 

First,  it  is  easy  to  verify  that  Eg(2)E;p(2)  =  Im  when  (9)  holds. 
Hence,  Eqs.  (12),  (13)  and  (15)  are  met.  Also,  through  simple  math 

I  _  h"(z)h(z) 

manipulations,  we  can  get  Eip(2)Eg(2) 


Im  — 


h(2)h-^  (2) 

0  1 


which  indicates  that  Eip(2)Eg(2)  is  a  Hermitian  matrix.  Therefore, 
(14)  also  holds.  □ 
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Remarks'. 

1.  Note  that  in  general,  Ejp(«)  given  by  (1 1)  corresponds  to  an 
HR  filterbank.  To  get  an  FIR  implementation,  we  can  approximate 
h{z)h.^  (z)  by  a  positive  constant  k  That  is,  at  the  reconstruction 
side,  we  can  replace  'Eij^{z)  by 

R(^)  =  [i^  _  (16) 

It  is  interesting  to  note  that  with  such  approximation,  the  PR  property 
in  (1)  is  retained. 

2.  When  H{z)  is  an  orthogonal  filter  and  G{z)  —  H{z),  we 
have  h{z)h^ {z)  —  1.  Under  these  constraints,  it  is  easy  to  show 

that  (11)  boils  down  to  Ej^iz)  =  [im  -  h[l)hg(z)  , 

which  is  exactly  E^(z)  as  expected.  In  this  special  case,  the  syn¬ 
thesis  bank  is  FIR. 


and  accordingly,  we  can  re-write  EAr(e^“)  into 

Im 


Eiv(e^“)  = 


d{e^ 


Ejv-i(e^“) 


Recall  that  for  any  two  matrices  X  and  Y,  the  inequality  rank(Y)  > 
rank{XY)  holds.  Hence,  we  have 

ranfc(Ejv-i(e'’“))  >  ranfc(EAr(e'’“))  =  M, 

where  we  have  used  the  fact  that  Ejv(a)  satisfies  the  PR  property. 
Also,  the  size  of  Ejv-i(e-’")  is  {N  —  1)  x  M,  which  indicates  that 


r'anfc(Ejv-i(e'’“))  <  M. 

Combining  the  above  two  inequalities,  we  know  that  Ejv_i(e-’“)  is 
of  full  rank  on  the  unit  circle.  □ 


4.  OFBS  FOR  ERASURE  CHANNELS 

Due  to  the  redundancy  introduced  in  frame  expansion,  OFBs  can 
be  used  as  joint  source-channel  codes  to  provide  robustness  to  era¬ 
sures  [7].  In  this  Section,  we  examine  the  resilience  of  OFBs  to  one 
erasure  channel,  based  on  Case  1  of  the  backward  Greville  formula. 
To  this  aim,  we  introduce  the  following  definition: 

Definition  1.  Let  Eiv(a:)  denote  the  N  x  M  analysis  polyphase  ma¬ 
trix  of  a  PR-OFB.  Denote  by  E{i}  {z)  the  polyphase  matrix  obtained 
by  deleting  the  i-th  row  ofE]sr{z).  Eat  (2:)  is  said  to  be  robust  to  one 
erasure  i/'E{i}(e'’“)  is  of  full  rank  on  the  unit  circle  [7], 

4.1.  OFBs  robust  to  one  erasure 

This  subsection  studies  the  necessary  and  sufficient  conditions  for 
OFBs  to  be  robust  to  one  erasure  channel.  Theorem  3  discusses  the 
case  of  general  PR-OFBs. 

Theorem  3.  Suppose  that  EAr(2)  is  the  polyphase  matrix  of  an  N- 
channel  PR-OFB  with  its  dual  frame  given  by  E]y(2).  Let  ei{z) 
and  vf  (z)  (for  i  =  1,  •  •  •  ,  N)  denote  the  i-th  row  vector  ofE{z) 
and  the  i-th  column  vector  of  E^j.^{z),  respectively.  Then,  Eiv(2)  is 
robust  to  one  erasure  if  and  only  if 

e,(e^'“)rf  (e^'“)  <  1  (17) 

for  i  —  1,  •  •  •  ,  A  and  for  all  u  £  [0,  27r). 

Proof.  Note  that  when  there  is  only  one  erasure  channel,  through 
row  permutation,  we  can  assume  that  erasure  occurs  in  the  A-th 

channel.  Let  Eat (2)  be  written  as  in  (3),  hence  E{ at}  (•?)  =  EAr-i(2) 

Without  loss  of  generality,  the  proof  is  equivalent  to  showing  that 
EAr-i(e^“)  defined  in  (3)  has  full  rank  if  and  only  if 

eAr(e^“)r^(e^")  <  1.  (18) 

The  “only  if’  part  is  obvious  as  when  EAr-i(e^")  is  of  full  rank, 
eN{e^“)  is  in  the  range  of  EAr-i(e^").  Hence,  by  the  backward 
Greville  formula,  (18)  holds.  For  the  “if’  part,  according  to  the  back¬ 
ward  Greville  algorithm,  when  (18)  holds,  eAr(e^")  is  in  the  range 
of  EAr-i(e^").  Hence,  there  exists  a  vector  d(e'’“’)  so  that 

eiv(e^'“)  =  d(e^“)Ejv-i(e^“). 


Example  1.  For  the  LP  frame  depicted  in  Fig.  1,  we  have  shown 
in  the  proof  of  Theorem  2  that  if  (9)  is  satisfied,  Eip(z)Ej^(z)  — 


Im  — 


h^(Uh(z) 

h(2)h«(2) 

0 


.  This  indicates  that  Bn {z)r^(z)  =  1.  By 


Theorem  3,  the  LP  frame  is  not  robust  to  one  erasure  channel  by 
using  biorthogonal  filters. 


For  the  special  case  when  Eat  (2)  implements  a  tight  frame,  i.e., 
when  E^(2)EAr(2)  =  AIm  with  A  >  0,  its  dual  frame  can  be  sim¬ 
ply  written  into  E]y(2)  =  ^E^(2).  A  consequence  of  Theorem  3 
is  as  follows: 


Corollary  I.  IfE]si{z)  corresponds  to  a  tight  frame,  i.e.,  when  it 
satisfies  E^(2)EAr(2)  =  AIm  with  A  >  0,  it  is  robust  to  one 
erasure  channel  if  and  only  if  its  i-th  row  vector  efiz)  satisfies 

ei(e'’“)ef  (e^“)  <  A  (19) 

for  all  i  =  1,  ■  ■  ■  ,  A  and  for  all  uj  £  [0,  27r). 

Remarks'. 

Note  that  [7]  also  investigated  the  case  where  there  is  only  one 
erasure.  But  the  discussions  there  are  focused  on  the  uniform  tight 
frame  (UTF),  a  special  class  of  tight  frames  with  equal  norm  for  each 
analysis  filter.  Our  derivations  are  for  general  frames  implemented 
via  PR  and  PU  OFBs.  It  can  be  shown  that  when  A  =  A/M,  Corol¬ 
lary  1  boils  down  to  Theorem  5  in  [7].  Although  theoretically,  UTFs 
provide  optimal  performance,  their  design  is  very  difficult.  On  the 
other  hand,  several  works  have  reported  simple  design  methods  and 
fast  implementations  for  cosine  modulated  OFBs  [12]  and  linear- 
phase  OFBs,  which  are  attractive  in  practical  applications  like  oth- 
orgonal  frequency-division  multiplexing  (OFDM)  and  image  cod¬ 
ing.  The  theory  developed  here  can  be  used  for  those  FBs  which  do 
not  generate  UTFs. 


4.2.  Implementation  structure 

Suppose  that  E at  (2)  is  robust  to  one  erasure  channel.  In  this  section, 
we  consider  the  following  problem:  when  the  erasure  occurs  in  one 
channel,  how  to  implement  the  dual  frame  of  the  remaining  analysis 
bank?  Again,  without  loss  of  generality,  let  us  assume  that  the  sub¬ 
band  coefficients  in  the  A-th  channel  are  completely  lost.  As  (18) 
holds,  by  using  the  backward  Greville  algorithm,  we  have 


can  be  determined  by  calculate  the  average  value  of  |h(e7“)p  for 
oj  £  [0,  27r) 


E]v_i(2)  =  RAr-l(2)  -I- 


r"(2)eiv(2) 

l-e^(2)r«(2) 


{z), 


(20) 
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where  all  the  notations  here  follow  those  of  Section  2.2.  By  (5), 


RAr_i(2)  can  be  expressed  as  Rjv-i(z)  =  E]y(z) 


Ijv-i 


.  Sub¬ 


stituting  it  into  (20),  we  arrive  at  the  following  expression  of  E  jy  _  (z) 


Ejv_i(z)  —  (1m  + 


rf  (z)ejv(z) 

1  -  eN{z)r^{z) 


E]vW 


Iat-I 

0 


(21) 


Example  2.  To  have  a  quick  check  of  (21),  let  us  consider  the  3x2 
Mercedes-Benz  (MB)  frame  [7]  with  the  analysis  polyphase  matrix 
0  1 


E3(2)  =  Es  = 


_  V3 
2 
y/3 
2 


.  As  E3  is  a  uniform  tight  frame 


in  [7],  it  is  robust  to  one  erasure  channel  with  the  dual  frame 
given  by  E3(2)  =  |Ei^.  Suppose  that  the  erasure  occurs  in  the  last 
channel  and  we  aim  to  reconstruct  the  signal  using  the  dual  frame  of 
0  1  1 

.  By  definitions  of  (3)  and  (5),  we  know  that 


E2{z)  = 
63(2)  = 


2 


^  and  rf  (z)  =  |e3^(2).  Substituting  E3(2), 


63(2)  andr^(z)  into  (21)  yields 'Ei\(z)  = 
is  exactly  the  inverse  ofE^i^z). 


3 

1 


2v/3' 

3 

0 


which 


Fig.  2  shows  the  corresponding  implementation  structure  of  (21). 
The  process  can  be  described  as  follows.  First,  in  the  frequency  do¬ 
main,  all  the  subband  coefficients  in  the  erasure  channel  (i.e.,  the 
N-th  channel  in  the  diagram)  are  set  to  zeros.  Then,  the  original 
dual  frame  E]y(2)  is  applied,  followed  by  a  time-domain  post-filter 

P(2)  =  Im  -f  yield  the  reconstructed  signal.  In 

particular,  the  filter  jg  compensate  for  the  era- 

l-e«-(2)r"  (z) 

sure  in  the  A^-th  channel. 

From  the  above  description,  one  can  see  that  our  proposed  struc¬ 
ture  in  Fig.  2  is  based  on  time-domain  post-processing  through  P(2). 
An  alternative  way  to  implement  E]y_3(2)  is  through  the  method 
proposed  in  [13],  where  the  lost  subband  coefficients  are  first  pre¬ 
dicted  in  the  frequency  domain  before  being  reconstructed  by  E]^  (2) . 
In  other  words,  the  structure  in  [13]  is  based  on  frequency  domain 
pre-filtering.  It  can  be  easily  shown  that  the  implementation  com¬ 
plexities  of  these  two  structures  are  about  the  same.  One  attractive 
property  of  our  proposed  structure  is  that  it  can  be  combined  with 
time-domain  over-sampled  lapped  transform  [14],  which  adds  time- 
domain  oversampled  pre-/post-filters  outside  the  DCT  and  the  IDCT. 
In  this  way,  exiting  DCT-based  standards  (like  the  JPEG)  can  be  in¬ 
tact.  One  of  our  on-going  works  is  to  investigate  the  theoretical  re¬ 
sult  presented  here  for  robust  transmission  of  images/videos  that  are 
compressed  by  the  DCT-based  codecs. 


5.  CONCLUSIONS 

In  this  paper,  we  have  studied  the  computation  of  the  dual  frame 
via  Greville’s  formulas.  We  derived  the  backward  Greville  formula, 
which  iteratively  computes  the  pseudo  inverse  of  a  matrix  when  a 
row  is  deleted.  The  applications  of  the  formulas  were  then  demon¬ 
strated.  In  particular,  the  Greville  formula  leads  to  a  closed-form 
solution  of  the  dual  frame  for  Laplacian  pyramids.  Based  on  the 
backward  Greville  formula,  we  derived  the  necessary  and  sufficient 
conditions  for  PR-OFBs  robust  to  one  erasure  channel.  We  also  pro¬ 
posed  a  post-filtering  structure  to  implement  the  dual  frame  in  the 
presence  one  erasure  channel.  Detailed  proofs  of  all  the  theorems 


•< -  - ► 

Fig.  2.  Post-filtering  based  implementation  structure  for  E]y_3(2) 


along  with  more  examples  and  their  practical  applications  will  be 

reported  in  the  journal  version. 
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